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Objective This study aimed to analyse the validity of the Thai version of the Cornell Scale for Depression in Dementia (CSDD) when 
using DSM-IV criteria. 

Methods A cross- sectional study was carried out of 84 elderly residents in a residential care home setting in Thailand. The participants 
went through a comprehensive geriatric assessment which included a Mini-Mental State Examination, a Mini-International Neuropsy- 
chiatric Interview (MINI) and use of the CSDD tool. A ROC analysis was performed in order to test the validity of the CSDD as against 
the DSM-IV when used by the MINI. 

Results ROC analysis revealed a better score for those areas found under the curve for the CSDD-as against the DSM-IV criteria 
(0.96). With a cut-off score of >6, the CSDD yielded the highest sensitivity score (100%), plus produced a specificity of 81% and a nega- 
tive predictive value of 100%. It also had a positive predictive value of 69%. The validity of the CSDD was found to be better for the 
group experiencing cognitive impairment than with the non-cognitive impairment group in terms of the agreement of CSDD items be- 
tween patients and caregivers. The CSDD yielded a high internal consistency (Cronbach's alpha=0.87). 

Conclusion CSDD is a valid tool to use for identifying depressive disorders among Thai LTC home residents - those experiencing and 
those not experiencing cognitive impairment. Psychiatry Investig 201 3; 1 0:359-364 
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INTRODUCTION 

Depression is commonly found among long-term care (LTC) 
home residents, though its prevalence varies,''^ with some 
studies finding rates of up to nearly 90%.'^ The inability to 
detect depression in nursing homes, and particularly among 
residents with dementia, is common;*"'' for example, Cohen 
et al.* found in their study that less than 25% of depression 
cases are identified and treated in such settings. When diag- 
nosing depression, one must be aware that the condition can 
be affected, not only by the age and gender of the respon- 
dents, but also by the environment they live in (even when 
the same measurement is used);'' therefore, the use of mea- 
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sures suited to specific populations and particular settings, 
such as long term care facilities, needs to be considered. In 
addition, there is strong evidence to suggest that language 
differences can cause differences in the factor structures of the 
measures used, and particularly among self-reporting tools.'" 

When attempting to screen for depression, the Cornell Scale 
for Depression in Dementia (CSDD)" is considered one of 
the best tools to use with cognitively impaired patients, and 
is thus widely used in LTC facilities. The introduction of 
mandatory screening with the CSDD has been shown to in- 
crease the proportion of depressed dementia patients receiv- 
ing anti-depressants from 20% (with no screening) to 44%.* 
The validity of the CSDD tool has been investigated and sub- 
stantiated, including cross-culturally.""" 

In terms of the validity of the CSDD, there have been two 
sets of results among the studies carried out thus far. The first 
set of studies has yielded a moderate level of accuracy - with 
an Area Under Curve (AUC) figure of around 0.70 to 0.80. 
For example, the studies of Leontjevas et al. reported an AUC 
figure of 0.76 for Provisional Criteria for Depression in Al- 
zheimer's Disease (PCD-dAD) among patients with early-on- 
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set dementia and also among proxy informants,'^ " which 
corresponds with the results of Barca et al.'^ and Watson et 
al.,'* who examined the validity of the CSDD among patients 
in LTC homes. Another set of studies has yielded a higher level 
of accuracy, with an AUG score of 0.90 or more. For example, 
Korner et al." reported an AUG of 0.98 to 0.99, while Schrein- 
er and Maimer et al."° reported an AUG of 0.90. Barca et al. 
argued that this difference was due to how strictly each study 
followed the assessment protocols suggested by Jaeschke et 
al.'^'^' Among the Thai elderly, the validity and reliability of 
the GSDD have never been studied; therefore, the aim of our 
study was to test the performance of the Thai version of the 
GSDD against standard diagnoses, using clinician-rated DSM- 
IV criteria for major depressive disorder (MDD). 

METHODS 

Participants and procedures 

The project was approved by the Ethics Gommittee at the 
Faculty of Medicine, Ghiang Mai University, and was con- 
ducted as a cross-sectional study. All subjects in the LTG were 
invited to participate, including the caregivers (nurses). Those 
who did not participate had active physical or psychiatric dis- 
eases that meant they were unable to communicate effectively, 
a situation which would have proved an obstacle to the inter- 
view process. As a result, they were excluded. 

Data were collected between March 2011 and June 2011. 
Of the 111 residents in the LTG invited to participate in the 
study, 84 agreed to participate, and informed consent was 
obtained from all of them. The participants included 84 pa- 
tients of 60 years-of-age and over residing in an LTG home 
in northern Thailand, as well as 5 caregivers. A trained re- 
search nurse initially performed a diagnostic interview, in 
order to carry out a psychiatric diagnosis and to assess cogni- 
tive functions, using the Thai version of the Mini-Interna- 
tional Neuropsychiatric Interview (MINI) tool - version 5.0,^^ 
plus the Mini-Mental State Examination Thai 2002 instru- 
ment (MMSE Thai 2002)." Both a patient and caregiver 
GSDD were employed by the research nurse, and both the 
caregivers and the patients were unaware of each others' scores. 

Instruments 

The MINI 

The Mini-International Neuropsychiatric Interview (MINI) 
instrument, developed by Sheehan,^'' was employed here as 
the standard for diagnosing DSM IV major depression,''^^'"*" 
with the Thai version validated by Kittiratanapaiboon et al.^^ 
The Thai version has kappa ranges of between 0.27 and 0.87 - 
showing the presence or otherwise of depressive disorders. 



In this study, the MINI and GSDD assessments were carried 
out 'bUnd' and independent of each other 

MMSE- Thai 2002 

Gognitive impairment is a condition that affects a persons 
ability to think, concentrate, develop ideas, reason and re- 
member, and when it develops with age is called dementia, 
though it can occur at any age.^* To measure the level of cogni- 
tive impairment among the participants in this study, the 
Mini-Mental State Examination (MMSE) was used, based on 
an original version used by Folstein et al."'^' The highest score 
possible is 30, and the cut-off score in relation to the presence 
of cognitive impairment or dementia among elderly subjects 
depends on their level of education. For those who have com- 
pleted elementary schooling, the cut-off score is 22 (out of 30); 
for those who have not it is 17 (out of 30) and for those who 
are illiterate, it is 14 (out of 23). 

Cornell Scale for Depression in Dementia 

The GSDD instrument was developed by Alexopoulos et 
aL,'" based on a review of the literature into depression among 
elderly patients and on a questiormaire completed by geriatric 
psychiatrists. It is used to rate the symptoms of depression 
found in an individual with dementia and contains nineteen 
questions, each of which can be given a score ranging from 0 
(absent) to 2 (severe), or the score 'symptoms not possible to 
evaluate'. The scale is divided into five sub-scales, these being: 
1) 'mood-related signs' (anxiety, sadness, a minimal reaction 
to pleasant events and irritability), 2) 'behavioral disturbance' 
(agitation, psychomotor retardation, multiple physical com- 
plaints and loss of interest), 3) 'physical signs' (loss of appetite, 
weight loss and lack of energy), 4) 'cyclic functions' (diurnal 
variation in mood, difficulty falling asleep, multiple awakening 
during the night and early morning awakening), and 5) 'ide- 
ational disturbance' (suicidal tendencies, low self-esteem, pes- 
simism and mood-congruent delusions). The tool's internal 
consistency/reliability has been found to range from 0.76 to 
0.84, and has shown a high level of correlation (r=0.96) with 
the diagnoses given by psychiatrists.'" 

Thai version of the CSDD 

The author (NW) was granted permission by the developer 
to translate the GSDD into Thai, following the translation 
and cultural adaptation method, a process which involved an 
initial translation into Thai by a geriatric psychiatrist (NW), 
then a backward translation into English by a bilingual transla- 
tor (a university professor) who had no prior knowledge of the 
questionnaire. The two versions produced were then assessed 
and compared item by item by the authors and the bilingual 
translator The resulting final draft was then field tested with 
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depressed elderly patients in a geriatric outpatient clinic - those 
not involved with the research project. A Cornell Scale assess- 
ment was carried out by a trained psycho-geriatric research 
nurse, who interviewed each patient and caregiver within a 
day of the depression being diagnosed by the MINI scale. 

Data analysis 

Means and standard deviations were used, and when com- 
paring the two groups, either an unpaired t-test or a Mann- 
Whitney test was adopted, as appropriate. The test perfor- 
mances of the CSDD were evaluated for both the cognitively 
impaired and cognitively intact groups, were determined by 
comparing the MMSE score for each participant with their in- 
di-vidual cut-off score - based on their level of education, and 
then examined using receiver operating characteristics (ROC) 
analyses of the sensitivity, specificity, positive predictive values 
(PPV) and negative predictive values (NPV) found. Point esti- 
mates and 95% confidence intervals (CIs) were computed to 
assess test performance characteristics across the difierent cut- 
offs and against the gold standard external diagnostic measure. 
To find the best cut-off score, the Youden index J was used. 



SPSS V. 17 (SPSS, Inc, USA) and MedCalc v 12.3 were used 
for the analysis (MedCalc Software, Mariakerke, Belgium). 

The level of reliability was assessed using Cronbachs alpha, 
for which the recommended cut-off criterion for the co-effi- 
cient alpha is 0.70." In this study, missing data was found in 
the responses of only one of the caregivers, for whom three 
CSDD items were missing. These missing items were then re- 
placed using the lowest score (zero), as suggested by Leontje- 
vas." 

RESULTS 

The demographic data, percentages of MDD diagnosis and 
CSDD scores are described in Table 1. Twenty-five of the 84 
participants (29.8%) were found to have MDD and 35 (41.7%) 
were found to have cognitive impairment. There was no dif- 
ference found in terms of the gender, marital status, years of 
education, and cognitive status of the respondents from the 
depressed and non-depressed groups; however, the CSDD 
scores were higher in the depressed group than in the non-de- 
pressed group (meaniSD, 13.60±3.66, and 4.64±3.17, p<0.001 



Table 1. Clinical characteristics of the sample (N=84) 




AU (N=84) 


Depressed (N=25) 


Non-depressed (N=59) p-value (two-sided) 


Age, mean±SD (min-max) 


75.8617.47 (60-94) 


76.52 1706 


75.281789 


<0.570t 


Gender, % female 


46 (54.8) 


16 (64.0) 


30 (50.8) 




<0.913* 


Marital Status (living together), N (%) 


9 (10.7) 


2 (8.0) 


7(11.8) 




<0.718* 


Years in Education, mean±SD (min-max) 


3.50±3.58 (0-12) 


3.3110.66 


3.5910.47 


<0.127t 


MMSE, meaniSD (min-max) 


18.1916.99(3-36) 


16.261753 


18.7716.77 


<0.102t 


Cognitive impairement*, N (%) 


35 (41.7) 


13 (52) 


22 (37) 




<0.234* 


CSDD, mean±SD (min-max) 


73115.28 (0-21) 


13.6013.66 


4.6413.17 




<0.001t 


Cronbachs alpha for CSDD 


0.87 


0.86 


0.86 






*chi-square test, tMann-Whitney U test, tMMSE below cut-off (see details in Methods section). CSDD: Cornell Scale for Depression in De- 


mentia, MMSE: Mini-Mental Status Examination 










Table 2. Comparing ROC curve analysis with cut-off scores according to cognitive status; and according to the source of informant 


Source of informant 


Cut-off 


Sensitivity 


Specificity 


PPV 


NPV 


(positive) 


(95% CI) 


(95% CI) 


(95% CI) 


(95% CI) 


(95% CI) 


Patient and Care-giver 84 (25) 


0.96 >6 


100.00 


81.36 


69.4 


100.0 


Cronbachs alpha=0.87 


(0.90-0.99) 


(86.3-100.0) 


(69.1-93.22) 


(51.9-83.7) 


(92.6-100) 


Care-giver only 


0.89 >5 


80 


88.14 


74.1 


91.2 


Cronbachs alpha=0.86 


(0.80-0.95) 


(59.3-93.2) 


(771-95.1) 


(53.7-88.9) 


(80.6-97.1) 


Patient only 


0.93 >6 


80 


89.83 


76.9 


91.4 


Cronbachs alpha=0.84 


(0.85-0.97) 


(59.3-93.2) 


(79.2-96.2) 


(55.9-91.2) 


(81.0-97.1) 


Cognitive impairment* 35(12) 


0.98 >9 


92.3 


95.45 


92.3 


95.5 




(0.86-100) 


(64.0-99.8) 


(772-99.9) 


(64.0-99.8) 


(77.2-99.0) 


Without cognitive 49 ( 1 2) 


0.96 >6 


100.00 


86.49 


70.6 


100.0 


impairment 


(0.86-1.00) 


(73.5-100.0) 


(71.2-95.5) 


(44.0-89.7) 


(88.8-100.0) 



*MMSE below cut-off (see details in Methods section). AUC: area under curve, CI: confidence interval, PPV: positive predictive value, NPV: 
negative predictive value, ROC: receiver operating characteristic 
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respectively). At the same time, CSDD scores were higher in 
the cognitively impaired group than in the cognitively intact 
group (meaniSD, 8.74±5.30, and 6.29±5.07, p=0.012 respec- 
tively), though this is not shown in the table. 

Cronbach's alpha for the whole group was 0.87, while for pa- 
tients, caregivers, depressed and non-depressed respondents 
the scores were 0.84, 0.86, 0.86 and 0.86 respectively (Table 1 
and 2). 

Validity of CSDD as against DSM-IV criteria using 
MINI 

As shown in Table 2, when using DSM-IV, for all subjects 
the AUG for the CSDD tool was 0.963 (SE 0.0175; 95% CI 
0.897-0.992), while for a cut-otf of >6, it yielded a sensitivity 
of 100%, a specificity of 81.36% - with a positive predictive 
value of 69.4%, and a negative value of 100%. When looking 
at the ROC curve analysis - according to cognitive fimction, the 
CSDD yielded an AUC of 0.976 (SE 0.022; 95% CI 0.87-1.00) 
and 0.962 (SE 0.046; 95% CI 0.79-0.98) for the cognitively im- 
paired and non-cognitively impaired groups respectively. 

When comparing the ROC curve analyses of the caregivers 
and patients, it was found that the caregiver CSDD yielded an 
AUC of 0.89 (95% CI 0.803-0.948), while the patient CSDD 
yielded an AUC of 0.929 (95% CI 0.851-0.973). 

Table 3 shows the different cut-off scores and coordinates 
for the CSDD ROC curve, using the standard protocol in 
which information from both patients and caregivers was used 
and the final scores for each item were based on the interview- 
er's judgment. At the cut-off score of >6, the Youden index J 
was at its highest, whereas at a score of >14, specificity was at 
its maximum. 

DISCUSSION 

Overall, the results demonstrate that the CSDD was able to 



detect MDD in the elderly, and especially in those with cogni- 
tive impairment. Our results seem to sit in the middle when 
compared to the findings of previous studies in this area, 
which have produced AUC figures ranging from 0.7 to 0.99.'^ 
When compared to a previous Asian sample from Japan,'^ we 
achieved a similar cut-off score using DSM-IV, but with a dif- 
ferent setting. The results from our study were similar to those 
from Japan, indicating that nurses may be a good substitute 
for caregivers when they are the only source available for diag- 
nosis. 

These findings have been endorsed by a recent report pro- 
duced by Leontjevas et al.,'' in which the CSDD was found to 
be better at ruling-out rather than mUng-in depression due to 
a low PPV. We yielded the same cut-off score as that study 
(>6); however, our Thai version showed a different AUC, which 
has to do with the different procedures used in the studies, for 
in our study the same rater administered both the MINI and 
CSDD tools, even though interviews were conducted on dif- 
ferent days. This may have led to the high AUC scores; howev- 
er, high AUC scores were also obtained in the Japan study, for 
which it is not clear how the ratings were used. We generated 
the same cut-off score as Lim et al."" in their study of Korean 
subjects, even though the diagnostic criteria used in each study 
were different. Interestingly, they found a higher level of speci- 
ficity than sensitivity in their study, which may have been due 
to differences in the sample characteristics, as their study was 
not conducted in a nursing home or long-term care home set- 
ting. 

As found in the previous studies, CSDD showed a good 
internal consistency here, with the Cronbach's alpha being 
good for all items (0.87)"''^- covering both the patient and 
caregiver samples; the depressed and non-depressed groups. 

Since the aim of this study was to focus on MDD, a cut-off 
of 6 or lower could be used to rule out major depressive epi- 
sodes (MDE) without missing depressed residents. As the 



Table 3. Sensitivity, specificity, positive and negative predictive value with 95% CI at different scores for the Cornell scale for depression 



Cut-off Sensitivity 



95% CI 



Specificity 



95% CI 



PPV 



95% CI 



NPV 



95% CI 



>3 


100.00 


86.3-100.0 


42.37 


29.6-55.9 


42.4 


29.6-55.9 


100.0 


85.8-100.0 


>4 


100.00 


86.3-100.0 


57.63 


44.1-70.4 


50.0 


35.5-64.5 


100.0 


89.7-100.0 


>5 


100.00 


86.3-100.0 


71.19 


57.9-82.2 


59.5 


43.3-74.4 


100.0 


91.4-100.0 


>6* 


100.00 


86.3-100.0 


81.36 


69.1-90.3 


69.4 


51.9-83.7 


100.0 


92.6-100.0 


>7 


92.00 


74.0-99.0 


88.14 


77.1-95.1 


76.7 


57.7-90.1 


96.3 


87.1-99.6 


>8 


84.00 


63.9-95.5 


93.22 


83.5-98.1 


84.0 


63.9-95.5 


93.2 


83.4-98.1 


>13 


44.00 


24.4-65.1 


98.31 


90.9-100.0 


91.7 


59.7-99.8 


80.6 


69.5-88.9 


>14 


36.00 


18.0-57.5 


100.00 


93.9-100.0 


100.0 


66.4-100.0 


78.7 


67.7-87.3 


>15 


24.00 


9.4-45.1 


100.00 


93.9-100.0 


100.0 


54.1-100.0 


75.6 


64.6-84.7 



*liighest Youden index J (0.814). CI: confidence interval, PPV: positive predictive value, NPV: negative predictive value 
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CSDD is a time-consuming tool to use, in the future it may be 
of benefit to use it to diagnose MDD without adding any fur- 
ther measurements. The generation of higher scores could 
then be used for diagnosis purposes; for example, a score of 14 
or more may suggest MDE without including non-major de- 
pressive cases, as in this study (Table 3). Alexopoulos et al.'° 
suggested that scores above 10 indicate probable major depres- 
sion, scores above 18 definitely indicate major depression, 
while scores below 6 as a rule are associated with the absence 
of any significant depressive symptoms. "'^^ 

How else can we make use of the CSDD in a long-term 
care setting? Snowdon et al.'^ discovered that routine use of a 
screening tool to identify depression in nursing homes is ben- 
eficial, particularly in cases of dementia. We agree with Snow- 
don'' that dementia with depression is more common in nurs- 
ing home or LTC facilities than elsewhere; therefore, using the 
CSDD as an outcome measure to monitor changes in symp- 
toms, so that residents with high CSDD scores may subse- 
quentiy receive antidepressants, is recommended, even though 
the CSDD is commonly considered a screening rather than a 
diagnostic tool. It is not only the incidence of depression in 
LTC facilities that has been under detected - there has also 
been little research into the effectiveness of antidepressants as 
compared to psychosocial interventions in LTC facilities or 
nursing homes. Moreover, as claimed by Bhamcha et al.^^ and 
Blanchard et al.,^*" psychosocial intervention in LTC facilities 
has also been little studied and under-utilized. In light of this, 
there is much more to explore in terms of the prevalence of 
depression among dementia patients in LTC facilities, and the 
CSDD will be an important tool in this process, one whose use 
should be promoted. CSDD can, not only establish the pres- 
ence of depression, but also measure the effectiveness of any 
interventions given in such a setting. 

This study did have some limitations. First, the sample size 
was relatively small, which precluded precision in terms of the 
point estimates and the study's power to detect the true dis- 
criminatory ability of any measure. In addition, a test-retest 
was not performed to ensure reliability. 

In conclusion, the CSDD is a valid tool for measuring de- 
pressive disorders among residents in a long term care setting, 
those both demonstrating and not demonstrating cognitive 
impairment. Therefore, it appears that this Thai version of the 
CSDD is suitable for screening purposes, and may be used to 
detect depression in a Thai long term care home setting. 
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